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FiHd tlip Tnvftntion 

This invention relates generally to an automatic white balance adjustment 
method and apparatus. More particularly, this invention relates to an automatic 
white balance adjustment method and apparatus for adjusting a white balance 
according to a type of a light source. 

r.»^r-pptinii nf Related Alt 

In a conventional white balance adjustment method, a differential signal 
(R - B) is calculated between a mean value of R signals and a mean value of B 
signals among red (R), green (G) and blue (B) signals on the whole rmage. A 
white balance is adjusted by adjusting gains of the R signals and the B signals so 
that the differential signal (R - B) can approach 0. In this method, however, the 
white balance is not properly adjusted if the color temperature of a subject .s 
distributed unevenly or if major parts of the image have a single color. 

In another conventional white balance adjustment/method, the range for 
adjusting the gains of R and B signals is limited according to a luminance level 
of the subject so that the white balance can be adjusted correctly (Japanese 
Patent Provisional Publication No. 5-64219). For a scene in wh.ch the 
differential signal (R - B) cannot approach 0, however, this conventional method 
only just reduces the incorrect adjustment, and the white balance cannot be 
suitably adjusted by this conventional method that adjusts the white balance so 
that the differential signal (R - B) can approach 0. 
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It is therefore an object of the present invention to provide an automatic 
white balance adjustment method and apparatus, which correctly determine the 
type of a light source, and adjusts the white balance according to the determined 

type of the light source. 

The above object can be accomplished by providing an automatic white 
balance adjustment method comprising the steps of: (a) determining a luminance 
level of a subject; (b) dividing an image plane, on which the subject is imaged, 
into a plurality of areas; (c) acquiring color information of each of the areas; (d) 
setting at least one determination frame indicating at least a color distribution 
range of a light source; (e) finding a number of the areas belonging to the 
determination frame in accordance with the color information of each of the 
areas acquired at step (c); (f) determining a type of a light source with which the 
subject is illuminated according to the luminance level of the subject determined 
at step (a) and the number of the areas belonging to the determination frame 
found at step (e); and (g) adjusting a white balance according to the type of the 
light source determined at step (f). 

According to the present invention, the type of the light source is 
determined according to the luminance level of the subject and the number of the 
divided image areas belonging to the determination frame. Then, the white 
balance is adjusted according to the determined type of the light source by 
controlling gains of R, G, B signals to the predetermined gains appropriate for 
the determined type of the light source. 

Preferably, the color information comprises a ratio R/G and a ratio B/G 
between R, G, B signals in each of the areas; and the determination frame is 
specified by a range of the ratio R/G and a range of the ratio B/G. The 
determination frame comprises a shade determination frame indicating a color 
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distribution range of a shade; and the area belonging to the shade determination 
frame is restricted to the area of which luminance is not more than a 
predetermined luminance. The determination frame comprises a blue sky 
determination frame indicating a color distribution range of a blue sky; and the 
5 area belonging to the blue sky determination frame is restricted to the area of 
which luminance is not less than a predetermined luminance. In the case of the 
color temperature is high, it is therefore possible to correctly determine whether 
the subject is blue due to the shade or the blue sky. 
□ Preferably, the step (f) determining the type of the light source comprises 

Jo the steps of: calculating an evaluation value expressing how much the subject 
appears in outdoor shade according to the following equation: 

the evaluation value expressing how much the subject appears in 
T outdoor shade = F(outdoor) x F(shade) x F(blue sky), 

m where F(outdoor) is a value of a membership function of which variable is the 
ift luminance level and F(outdoor) expresses how much the subject appears 
;i outdoors, F(shade) is a value of a membership function of which variable is the 
number of the areas belonging to the shade determination frame and F(shade) 
expresses how much the subject appears in shade, F(blue sky) is a value of a 
membership function of which variable is the number of the areas belonging to 
20 the blue sky determination frame; determining that the type of the light source is 
outdoor shade when the evaluation value is not less than a predetermined value; 
and determining that the type of the light source is daylight when the evaluation 
value is less than the predetermined value. 

Preferably, the automatic white balance adjustment method further 
25 comprises the step of: determining whether to flash an electronic flash according 
to the luminance level of the subject determined at step (a), wherein the step (f) 
is performed only when it is determined not to flash the electronic flash, and the 
type of the light source is determined as the electronic flash when it is 



determined to flash the electronic flash. 

Preferably, the type of the light source comprises a shade, a fluorescent 
lamp and an electric bulb; and the determination frames comprises a shade 
determination frame indicating a color distribution range of a shade, a 
fluorescent lamp determination frame indicating a color distribution range of a 
fluorescent lamp, an electric bulb determination frame indicating a color 
distribution range of an electric bulb, a blue sky determination frame indicating a 
color distribution range of a blue sky and a skin pigmentation determination 
frame indicating a color distribution range of a skin pigmentation. 

Preferably, the step (f) determining the type of the light source comprises 
the steps of: calculating an evaluation value expressing how much the subject 
appears in outdoor shade, an evaluation value expressing how much the light 
source appears the fluorescent lamp, and an evaluation value expressing how 
much the light source appears the electric bulb according to the following 
equations: 

the evaluation value expressing how much the subject appears in 
outdoor shade = F(outdoor) x F(shade) x F(blue sky); 

the evaluation value expressing how much the light source 
appears the fluorescent lamp = Fi(indoor) x F(fluorescent lamp); and 

the evaluation value expressing how much the light source 
appears the electric bulb = F2(indoor) x F(electric bulb) x F(skin pigmentation), 
where F(outdoor) is a value of a membership function of which variable is the 
luminance level and F(outdoor) expresses how much the subject appears 
outdoors, F(shade) is a value of a membership function of which variable is the 
number of the areas belonging to the shade determination frame and F(shade) 
expresses how much the subject appears in shade, F(blue sky) is a value of a 
membership function of which variable is the number of the areas belonging to 
the blue sky determination frame, Fi(indoor) is a value of a membership function 



of which variable is the luminance level and Fi(indoor) expresses how much the 
subject appears indoors and the light source is the fluorescent lamp, F2(indoor) is 
a value of a membership function of which variable is the luminance level and 
F2(indoor) expresses how much the subject appears indoors and the light source 
is the electric bulb, F(fluorescent lamp) is a value of a membership function of 
which variable is the numbers of the areas belonging to the fluorescent lamp 
determination frame and F(fluorescent lamp) expresses how much the light 
source appears the fluorescent lamp, F(electric bulb) is a value of a membership 
function of which variable is the numbers of the areas belonging to the electric 
bulb determination frame and F(electric bulb) expresses how much the light 
source appears the electric bulb, and F(skin pigmentation) is a value of a 
membership function of which variable is the numbers of the areas belonging to 
the skin pigmentation determination frame and F(skin pigmentation) expresses 
how much the subject appears to include the skin pigmentation; determining, 
when a maximum one of the evaluation values is not less than a predetermined 
value, that the type of the light source is as the light source corresponding to the 
maximum one of the evaluation values; and determining that the type of the light 
source is daylight when the maximum one of the evaluation values is less than 
the predetermined value. 

RPTFF DRSCP TPTTON OF THF, DRAWINGS 

The nature of this invention, as well as other objects and advantages 
thereof, will be explained in the following with reference to the accompanying 
drawings, in which like reference characters designate the same or similar parts 
throughout the figures and wherein: 

Fig. 1 is a block diagram showing an embodiment of a digital camera, to 
which an automatic white balance adjustment method and apparatus according to 



the present invention is applied; 

Fig. 2 is a flow chart of assistance in explaining an automatic white 
balance adjustment method in a low luminance flash mode; 

Fig. 3 is a flow chart of assistance in explaining an automatic white 
balance adjustment method in a flash prohibition mode; 

Fig. 4 is a graph showing determination frames indicating the color 
distribution ranges of various light sources; 

Fig. 5 is a graph showing a membership function expressing how much 

the subject appears outdoors; 

Fig. 6 is a graph showing a membership function expressing how much 

the subject appears indoors; 

Fig. 7 is a graph showing a membership function expressing how much 

the subject appears in shade; 

Fig. 8 is a graph showing a membership function expressing how much 

the scene appears to include a blue sky; 

Fig. 9 is a graph showing a membership function expressing how much 
the light source appears a fluorescent light or an electric bulb; and 

Fig. 10 is a graph showing a membership function of a skin pigmentation. 

nT^TATT FD DRS PF irTTO N ^F TF^ PpPFFT^T^FD F MBODTMRNT 

This invention will be described in further detail by way of example with 
reference to the accompanying drawings. 

Fig. 1 is a block diagram showing an embodiment of a digital camera, to 
which an auto-balance adjustment method according to the present invention is 
applied. 

An image of a subject is formed on a light receiving surface of a charge 
coupled device (CCD) 14 through a taking lens 10 and a diaphragm 12, and is 
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converted into a signal electric charge corresponding to the quantity of madent 
light in each sensor. The accumulated signal electric charges are read into a 
shift register by read gate pulses transmitted from a CCD drive circuit 16, and 
are sequentially read as voltage signals corresponding to the signal electrrc 
charges by register transfer pulses. The CCD 14 has a so-called electronic 
shutter function for discharging the accumulated signal electric charges by 
shutter gate pulses to control an electric charge accumulation time (a shutter 

Speed). 1- J . „ 

The voltage signals read sequentially from the CCD 14 are supplied to a 

correlation double sampling (CDS) circuit 18, which sample-holds R, G and B 
signals in each pixel. Then, the R, G and B signals are supplied to an AID 
converter 20. The A/D converter 20 converts the R, G and B signals, which are 
fed sequentially from the CDS circuit 18, into digital R. G and B signals of 10 
bits (0-1023), and then outputs the converted signals. The CCD drive circuit 16, 
the CDS circuit 18 and the A/D converter 20 are driven in synchronism with 
timing signals supplied from a timing generator 22. 

The R G and B signals outputted from the A/D converter 20 are stored m 
a memory 24, and then, they are supplied from the memory 24 to a digital signal 
processing circuit 26. The digital signal processing circuit 26 comprises a 
-0 synchronization circuit 28, a white balance adjustment circuit 30, a gamma 
correction circuit 32, a YC signal generating circuit 34 and a memory 36. 

The synchronization circuit 28 converts the dot-sequential R, G and B 
signals read from the memory 24 into synchronous signals, and synchronously 
outputs the R, G and B signals to the white balance adjustment circuit 30. The 
25 white balance adjustment circuit 30 comprises multipliers 30R, 30G and 30B for 
increasing or decreasing digital values of the R, G, B signals. The R, G, B 
signals are supplied to the multipliers 30R, 30G, 30B, respectively. Gam values 
Rg Gg Bg are also supplied to the multipliers 30R, 30G, 30B, respectively. 
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from a central processing unit (CPU) 38. The multipliers 30R, 30B, 30G 
multiply the R, G, B signals by the gain values Rg, Gg, Bg to obtain R', G', B'^ 
signals with the adjusted white balance, respectively. The obtained R', G', B' 
signals are outputted to the gamma correction circuit 32. A detailed description 
will later be given of the gain values Rg, Gg, Bg supplied from the CPU 38 to 
the white balance adjustment circuit 30. 

The gamma correction circuit 32 changes the input/output characteristics 
to achieve desired gamma characteristics of the white-balance adjusted R', G', 
B' signals, and changes the 10-bit signals to 8-bit signals which are outputted to 
the YC signal generating circuit 34. The YC signal generating circuit 34 
generates a luminance signal Y and chroma signals Cr, Cb from the gamma- 
corrected R, G, B signals. The luminance signal Y and the chroma signals Cr, 
Cb (YC signals) are stored in the memory 36. 

The YC signals stored in the memory 36 at the image-capturing are 
compressed in a predetermined format by a compression circuit (not illustrated), 
and are recorded in a storage medium such as a memory card. 

The CPU 38 controls the circuits in accordance with the inputs from the 
camera control part 40 including a shutter release button, etc., and performs an 
automatic focusing, an automatic exposure control, an automatic white balance 
adjustment, and the like. The auto focusing is, for example, a contrast AF for 
moving the taking lens 10 so that the high frequency component of the G signal 
achieves the maximum. When the shutter release button is half pressed, a lens 
driver 42 moves the taking lens 10 to a focusing position so that the high 
frequency component of the G signal achieves the maximum. 
25 In the automatic exposure control, a subject luminance (image-capturing 

EV) is found from an integrated value of R, G, B signals in one frame, and a 
diaphragm value and a shutter speed are determined according to the image- 
capturing EV. A diaphragm driver 44 drives the diaphragm 12, and the 
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electronic shutter fanction controls the electric charge accumulation time to 
achieve the determined shutter speed. R, G, B signals in one frame are obtained 
again to find an image-capturing EV again. When the shutter release button rs 
half pressed, the above-described photometry operation is repeated a plurality of 
times to find a correct image-capturing EV. and the diaphragm value and the 
shutter speed for the image-capturing are finally determined according to the 
image-capturing EV. When the shutter release button is fully pressed, the 
diaphragm driver 44 drives the diaphragm in such a manner as to achieve the 
determined diaphragm value, and the electronic shutter function controls the 
electric charge accumulation time in such a manner as to achieve the determmed 
shutter speed. 

A description will now be given of the automatic white balance 

adjustment method. 

The digital camera has an electronic flash 46, and has a low luminance 
automatic flash mode for automatically flashing the electronic flash 46 when the 
subject luminance is low, a compulsory flash mode for flashing the electromc 
flash 46 regardless of the subject luminance, a flash prohibition mode for 
prohibiting the electronic flash 46 from flashing, and the like. The mode is 
selected by operating an electronic flash key (not illustrated). The white 
balance is adjusted according to the selected mode. 

Referring to a flow chart of Fig. 2, there will be explained the automatic 
white balance adjustment method in the low luminance automatic flash mode. 
rA3Slf the image-capturing EV is obtained when the shutter rele^^buttonV 
half pressed (step SIO), whether to flash the electronicjlash-l^ not is 
determined according to the image-cagtupnr*VlS5 S12). If the image- 
capturing EV is a predetermi,xe*^(10EV) or less, it is determined that the 
electronic flash 46§h«(ildbe flashed, and the white balance is adjusted according 
to the elecjiol^^ash light (step S14). More specifically, the white balance 
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gain values Rg, Gg, Bg are pre^dous^^ 

balance accordiiig-te-th^^^^ light, and the gain values Rg, Gg, Bg 

tupp^to the white balance adjustment circuit 30. 

If it is determined that the electronic flash 46 should not be flashed, the 
5 entire image plane is divided into a plurality of areas (e.g., 64 X 64), and average 
integrated values of R, G, B signals in the respective areas are found to thereby 
find a ratio R/G between the integrated value of the R signal and the integrated 
value of the G signal and a ratio B/G between the integrated value of the B signal 
and the integrated value of the G signal (step S16). An integration circuit 48 in 
0 Fig. 1 calculates the average integrated values of the R, G, B signals in each area, 
and the average integrated values are supplied to the CPU 38. Multipliers 50R, 
50G, SOB are provided between the integration circuit 48 and the CPU 38, and 
adjustment gain values are supplied to the multipliers 50R, 50G, SOB to adjust 
the unevenness between the multipliers 50R, SOG, SOB. 
L5 Next, how much the subject appears in outdoor shade or not is 

determined (step S18). The determination is based on the calculation of an 

evaluation value as follows: 

Evaluation value expressing how much the subject appears both 

outdoors and in shade = F(outdoor) x F(shade) x F(blue sky) , (1) 
20 where F(outdoor) expresses how much the subject appears outdoors and 
F(outdoor) is a value of a membership function shown in Fig. S of which 
variable is the image-capturing EV, F(shade) expresses how much the subject 
appears in shade and F(shade) is a value of a membership function shown in Fig. 
7 of which variable is the number of areas of which luminances are less than a 
predetermined luminance and which are within a shade determination frame in 
Fig. 4, and F(blue sky) expresses how much the scene appears to include a blue 
sky and is a value of a membership function shown in Fig. 8 of which variable is 
the number of areas within a blue sky determination frame in Fig. 4. 
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The luminance (Evi) in each area is calculated by the following equation: 
Evi = EV + log2(Gi/45), (2) 
where EV is the image-capturing EV and Gi is an average integrated value of G 
signals in each area. In this equation, 45 is an optimum value among the 

converted A/D values. 

As shown in Fig. 4, the shade determination frame, the blue sky 

determination frame, and the like are shown in a graph of which horizontal axis 

is ratio R/G and vertical axis is ratio B/G, and each determination frame specifies 

a color distribution of a kind of a light source or the like. 

F(shade) is found from the membership function in Fig. 7 on the basis of 
the number of areas that have Evi, which is calculated by the equation (2), of 12 
or less and also have both ratios R/G and B/G belonging to the shade 
determination frame in Fig. 4. Likewise, F(blue sky) is found from the 
membership function in Fig. 8 on the basis of the number of areas that have Evi 
of more than 12.5 and also have both ratios R/G and B/G belonging to the blue 
sky determination frame in Fig. 4. F(blue sky) operates in such a manner as to 
decrease the evaluation value expressing how much the subject appears both 
outdoors and in shade as the number of areas within the blue sky determination 
frame increases. 

At the step S18 in Fig. 2, the values of the membership function of 
F(outdoor), F(shade) and F(blue sky) are integrated to find the evaluation value 
expressing how much the subject appears both outdoors and in shade. At the 
step S20, it is determined whether or not the evaluation value found at the step 
SIS is a predetermined reference value (0.47 in this embodiment) or more. If 
the evaluation value is 0.47 or more, it is determined that the subject is both 
outdoors and in shade. Accordingly, the white balance is adjusted suitably for 

the outdoor shade (step S22). 

If the evaluation value is less than 0.47, it is determined that the light 
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source is daylight (fair weather), and the white balance is adjusted suitably for 
the daylight (step S24). The white balance gain values Rg, Gg, Bg are prepared 
in advance in order to satisfactorily adjust the white balance for the outdoor 
shade and the daylight. The white balance is adjusted suitably for the outdoor 
shade and the daylight in such a manner that the appropriate gain values Rg, Gg, 
Bg are supplied to the white balance adjustment circuit 30. 

Referring next to a flow chart in Fig. 3, there will be explained the white 
balance adjustment method in the flash prohibition mode. 

In this case, the image-capturing EV is acquired when the shutter button 
) is half pressed (step S30), and the ratios R/G and B/G are found in 64x64 areas 
divided from the entire image plane (step S32). 

Next, evaluation values expressing how much the light source appears a 
daylight fluorescent lamp, a white daylight fluorescent lamp, a white light 
fluorescent lamp or a tungsten electric bulb as well as the evaluation value 
5 expressing how much the subject appears both outdoors and in shade are 
calculated by the following equations (step S34): 

Evaluation value expressing how much the light source appears a 
daylight fluorescent lamp = Fi(indoor) x F(daylight fluorescent lamp); (3) 
Evaluation value expressing how much the light source appears a 
20 white daylight fluorescent lamp = F,(indoor) x F(white daylight light fluorescent 

(4) 

lamp); 

Evaluation value expressing how much the light source appears a 
white fluorescent lamp = Fi(indoor) x F(white fluorescent lamp); and (5) 
Evaluation value expressing how much the light source appears a 
25 tungsten electric bulb = F,(indoor) x F(electric bulb) x F(skin pigmentation). (6) 
In the above equations (3)-(5), F,(indoor) expresses how much the 
subject appears indoors and the light source is the fluorescent lamp, and 
Fi(indoor) is a value of a membership function shown in Fig. 6 of which variable 
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is the image-capturing EV. In the above equation (6), F^Cindoor) expresses how 
much the subject appears indoors and the light source is the tungsten electric 
bulb, and F^Cindoor) is a value of a membership function shown in Fig. 6 of 
which variable is the image-capturing EV that are in parentheses in FIG. 6. In 
the above equations (3)-(6), F(daylight fluorescent lamp), F(white daylight 
fluorescent lamp), F(white fluorescent lamp) and F(electric bulb) express how 
much the light source appears the daylight fluorescent lamp, the white daylight 
fluorescent lamp, the white fluorescent lamp and the tungsten electric bulb, 
respectively. F(daylight fluorescent lamp), F(white daylight fluorescent lamp), 
F(white fluorescent lamp) and F(electric bulb) are values of membership 
functions shown in Fig. 9 of which variables are the numbers of areas within a 
daylight fluorescent lamp determination frame, a white daylight fluorescent lamp 
determination frame, a white fluorescent lamp determination frame and a 
tungsten electric bulb determination frame, respectively, in Fig. 4. 

In the above equation (6), F(skin pigmentation) expresses how much the 
subject appears to include a skin pigmentation and is a value of a membership 
function shown in Fig. 10 of which variable is the number of areas belonging to 
a skin pigmentation determination frame in Fig. 4. F(skin pigmentation) 
operates in such a manner as to lower the evaluation value expressing how much 
the light source appears the electric bulb as the number of areas within the skin 
pigmentation determination frame increases. This is because a red tinge 
disappears and people turn pale if the white balance is adjusted intensively with 
respect to the tungsten electric bulb for the subject including the skin 
pigmentation. 

When the evaluation value how much the subject appears both outdoors 
and in shade (see the equation (1)), the evaluation value how much the light 
source appears the daylight fluorescent lamp, the evaluation value how much the 
light source appears the white daylight fluorescent lamp, the evaluation value 
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how much the light source appears the white fluorescent lamp and the evaluation 
value how much the light source appears the electric bulb are calculated, it is 
determined whether or not the value of the maximum one of these five 
evaluation values is 0.47 or more (step S36 in Fig. 3). If the maximum value is 
0.47 or more, the white balance is adjusted according to the color of the light 
source corresponding to the maximum evaluation value (step S38). 

If the maximum evaluation value is less than 0.47, it is determined that 
the light source is the daylight, and the white balance is adjusted suitably for the 

daylight (step S40). 

In order to satisfactorily adjust the white balance suitably for the outdoor 
shade, the daylight fluorescent lamp, the white daylight fluorescent lamp, the 
white fluorescent lamp, the tungsten electric bulb and the daylight, the white 
balance gain values Rg, Gg, Bg are prepared in advance, and the appropriate gain 
values Rg, Gg, Bg are supplied to the white balance adjustment circuit 30. 

More specifically, the white balance adjustment circuit 30 obtains the 
corrected signals R', G', B' as follows: 

R' = Rg X R ; (7) 
G' = Gg X G ; and (8) 
B' = Bg X B (9) 
where Rg, Gg, Bg are the preset gain values, and R, G, B are the signals to be 
corrected. 

The gain values may be changed according to the degree of the scene (the 
evaluation value) as shown in the following equations: 

R' = {(Rg - 1) X (evaluation value) + 1} x R ; (10) 
G' = {(Gg - 1) X (evaluation value) + 1} x G ; and (11) 
B' = {(Bg - 1) X (evaluation value) + 1} x B . (12) 
The preset gain values Rg, Gg, Bg for the different types of light sources 
are empirically set within the range between 0.9 and 1.5. If the gain values are 
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changed according to the evaluation value, the continuity of the scenes is 
maintained. 

In this embodiment, the evaluation values for determining the type of the 
light source are calculated by the equations (1), (3)-(6), but the evaluation values 
may also be calculated by taking one or more other factors (other membership 
functions) into account. The types of the light sources should not be restricted 
to this embodiment; for example, only one or two kinds of fluorescent lamps 
may be determined. 

As set forth hereinabove, according to the present invention, the type of 
the light source is determined correctly, so that the white balance can be 
satisfactorily adjusted according to the type of the light source. 

It should be understood, however, that there is no intention to limit the 
invention to the specific forms disclosed, but on the contrary, the invention is to 
cover all modifications, alternate constructions and equivalents falling within the 
spirit and scope of the invention as expressed in the appended claims. 



